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Executive  Summary 


This  report  was  i)repared  at  the  request  of  the  Office  of  Codes  and  Standards  of 
the  U.S.  Department  of  Energy  (DOE).  It  analyzes  two  proposals  for  establishing 
compliance  with  the  average  efficiency  levels  prescribed  by  section  342(b)(1)  of  the 
Energy  Policy  and  Conservation  Act  of  1975,  as  amended  (EPCA):  The  Department 
of  Energy’s  Proposed  Rule  for  Electric  Motors,  at  10  Code  of  Federal  Regulations 
Part  431,  sections  431.24  and  431.127,  published  in  the  Federal  Register,  November 
27,  1996;  and  the  April  18,  1997,  “Proposal  for  the  Method  of  Determining  Compli- 
ance and  Enforcement  for  Electric  Motors  under  the  Efficiency  Labeling  Program 
of  DOE,  10  CFR  Part  431,”  submitted  by  the  Motor  and  Generator  Section  of  the 
National  Electrical  Manufacturers  Association  (NEMA). 

Under  section  431.24  of  the  DOE’s  Proposed  Rule  for  compliance  with  EPCA,  the 
manufacturer  would  determine  the  average  full-load  efficiency  of  each  basic  model 
of  electric  motor  either  by  testing  or  by  application  of  an  Alternative  Efficiency 
Determination  Method  (AEDM).  Under  section  431.127  of  DOE’s  Proposed  Rule 
for  enforcement  of  EPCA,  the  DOE  would  ascertain,  through  an  enforcement  sam- 
pling plan,  the  accuracy  of  information  disclosed  in  the  labeling  and  the  marking  of 
the  electric  motor  to  indicate  its  energy  efficiency,  and  whether  the  motor  complies 
with  EPCA  standards. 

During  the  public  comment  period,  NEMA  raised  issues  concerning  the  DOE’s 
proposed  sampling  plans  for  compliance  and  enforcement.  According  to  NEMA,  the 
compliance  criteria  in  the  Proposed  Rule  are  inconsistent  with  NEMA  Standards 
Publication  MGl-1993,  “Motors  and  Generators,”  and  place  a high  burden  on 
manufacturers.  Moreover,  NEMA  contends  that  the  Proposed  Rule  would  require 
that  electric  motors  covered  by  EPCA  be  engineered  to  exceed  the  average  full-load 
efficiency  levels  prescribed  by  EPCA. 

This  report  evaluates  the  operating  characteristics  of  the  DOE’s  and  NEMA’s  pro- 
posals within  the  context  of  EPCA:  Comi)hance  with  the  energy  efficiency  levels 
for  motors  prescribed  by  section  342(b)(1)  of  EPCA  appears  to  be  satished  when 
the  true  mean  full-load  efficiency  of  the  population  of  each  basic  model  of  electric 
motor  equals  or  exceeds  the  applicable  nominal  full-load  efficiency. 
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Analysis  of  Proposals  for  Compliance  and  Enforcement 
Testing  Under  the  New  Part  431;  Title  10,  Code  of  Federal 

Regulations 


Introduction 

This  report  was  prepared  at  the  request  of  the  Of- 
hce  of  Codes  and  Standards  of  the  U.S.  Department 
of  Energy  (DOE).  It  analyzes  various  criteria  and  sam- 
pling plans  proposed  for  establishing  compliance  with 
the  nominal  full-load  efficiency  levels  prescribed  by 
the  Energy  Policy  and  Conservation  Act  (EPCA),  42 
U.S.C.  6313(b)(1)  [1].^  The  report  discusses,  in  detail, 
two  proposals:  (1)  the  Notice  of  Proposed  Rulemaking 
(NOPR)  for  electric  motors  published  in  the  Federal 
Register  on  November  27,  1996  [2];  and  (2)  a proposal 
prepared  by  the  National  Electrical  Manufacturers  As- 
sociation (NEMA),  Motor  and  Generator  Section  [3], 
which  was  submitted  in  response  to  the  call  for  public 
comment  given  in  the  NOPR. 

This  report  evaluates  the  operating  characteristics  of 
these  proposals  in  the  context  of  the  EPCA  require- 
ments. Section  342(b)(1)  of  EPCA  requires  that  each 
electric  motor  manufactured  (alone  or  as  a conii)onent 
of  another  piece  of  equipment)  have  a nominal  full-load 
efficiency  of  not  less  than  the  prescribed  level.  This  re- 
port assumes  that  the  energy  efficiency  requirement  of 
the  legislation  is  satisfied  if  the  mean  full-load  efficiency 
of  the  entire  population  of  motors  of  each  basic  model 
covered  by  the  legislation  ecpials  or  exceeds  the  appli- 
cable nominal  efficiency. 

Under  the  NOPR,  efficiency  testing  is  required  in  three 
contexts: 

1.  compliance  testing, 

2.  substantiation  of  Alternative  Efficiency  Determi- 
nation Methods  (AEDM),  and 

3.  enforcement  testing. 

The  statement  submitted  by  the  NEMA,  Motor  an 
Generator  Section  [3],  raises  significant  issues  regarding 
the  NOPR: 

^Numbers  in  square  brackets  refer  to  articles  listed  in  the 
References. 


1.  The  electric  motor  manufacturers  maintain  that 
the  NOPR  compliance  criteria  (1)  are  inconsistent 
with  NEMA  Standard  MG  1-1993  [4],  (2)  place 
a high  burden  on  manufacturers  in  that  the  risk 
of  false  determination  of  noncompliance  can  be 
as  high  as  50  percent  for  motors  in  compliance 
with  the  NEMA  labeling  guidelines,  and  (3)  in 
effect,  ensure  compliance  with  the  EPCA  energy 
efficiency  levels  for  electric  motors  by  requiring 
that  covered  eciuiprnent  be  engineered  to  exceed 
the  average  full-load  efficiency  levels  established 
by  EPCA. 

2.  The  electric  motor  manufactureres  maintain  that 
the  methods  proposed  for  compliance  and  enforce- 
ment testing  by  the  NOPR  are  not  harmonized. 

This  report  seeks  to  clarify  such  issues. 

Methods 

This  report  compares  the  NOPR  and  NEMA  proposals 
through  model  calculations  of  their  operating  charac- 
teristics, i.e.,  an  estimated  probability  of  demonstrating 
compliance  for  a population  of  motors  having  a specific 
mean  efficiency  and  standard  deviation.  Modeling  the 
operating  characteristics  of  the  NOPR  and  NEMA  pro- 
posals requires  detailed  information  al)Out  the  distribu- 
tion of  motor  efficiencies.  Ideally,  such  model  calcula- 
tions would  be  based  on  energy  efficiency  data  gath- 
ered from  extensive  testing;  in  the  absence  of  such 
data,  however,  this  report  must  infer  information  from 
the  energy  efficiency  labeling  guidelines  estaljfished  by 
NEMA  Standard  MG  1-1993.  Such  guidelines  were  de- 
veloped by  consensus  among  motor  manufacturers  and 
are  voluntarily  followed  by  many  motor  manufacturers. 
To  quote  from  NEMA  MGl-1993.  paragraph  12.58.2, 
Efficiency  of  Polyphase  Squirrel-Cage  Medium  Motors 
with  Continuous  Rating  [4]: 

\ariations  in  materials,  manufacturing  pro- 
cesses, and  tests  result  in  motor-to-motor  ef- 
ficiency variations  for  a given  motor  design: 
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the  full-load  efficiency  for  a large  population 
of  motor  of  a single  design  is  not  a unique  effi- 
ciency but  rather  a band  of  efficiency.  There- 
fore, Table  12-8  [of  NEMA  MGl-1993]  has 
been  established  to  indicate  a logical  series  of 
nominal  motor  efficiencies  and  the  minimum 
associated  with  each  nominal.  The  nominal 
efficiency  represents  a value  which  should  be 
used  to  compute  the  energy  consumption  of  a 
motor  or  a group  of  motors. 

Although  the  IMG  1 guidelines  were  developed  primar- 
ily to  provide  uniformity  in  motor  efficiency  labeling, 
they  are  used  for  purposes  of  quality  control  by  many 
manufacturers  and  may,  therefore,  provide  a reasonable 
basis  to  estimate  efficiency  performance. 

The  analysis  contained  in  this  report  is  of  value  primar- 
ily as  a qualitative  comparison  of  the  operating  char- 
acteristics of  the  NOPR  and  NEMxA.  proposals,  and, 
secondarily,  as  a quantitative  estimate  of  the  risk,  or 
statistical  confidence,  associated  with  motor  testing  un- 
der such  proposals.  The  quantitative  estimation  of  risk 
can  be  tenuous,  since  the  results  of  these  calculations 
depend  on  the  model  assumptions.  Consequently,  high 
significance  should  not  be  placed  on  these  estimates  of 
risk. 

Industry  practice 

Guidelines  for  motor  efficiency  labeling  are  provided 
in  paragraph  12.58.2  of  NEMA  Standard  MG  1-1993. 
Table  12-8  of  that  section  establishes  a series  of  Nom- 
inal Efficiencies  that  are  used  for  purposes  of  labeling 
and  a Minimum  Efficiency  associated  with  each  Nomi- 
nal value.  Under  the  MG  1 guidelines,  two  conditions 
must  be  satisfied  for  a motor  to  be  labeled  at  a given 
Nominal  Efficiency: 

1.  “ . . . the  Nominal  Efficiency. . . shall  be  not  greater 
than  the  average  efficiency  of  a large  population  of 
motors  of  the  same  design.” 

2.  “The  full-load  efficiency. . . shall  be  not  less  than 
the  minimum  value. . . associated  with  the  nominal 
value. . . ” 

The  MG  1 guidelines  are  shown  graphically  in  Fig.  1. 
In  the  hgure,  the  Nominal  Efficiencies  are  indicated 
by  their  full-load  losses,  where  100  percent  of  the 
full-load  losses  is  equal  to  the  difference,  100  — 
Nominal  Efficiency.  For  this  discussion,  we  dehne  the 
loss  fraction  by  the  ratio, 

^ _ . 100  — True  Full-load  Efficiency 

Loss  fraction  = ^ x 100, 

100  — Nominal  Efficiency 


Increasing  Efficiency  ► 


Figure  1:  Graphical  representation  of  MG  1 efficiencies. 
EPCA  nominal  efficiencies  correspond  to  the  vertical  line  at 
100  percent  of  full-load  losses.  The  vertical  lines  grouped 
around  90  percent  and  110  percent  correspond  respectively 
to  the  next  higher  and  lower  MG  1 Nominal  Efficiencies. 
The  MG  1 Minimum  Efficiencies  correspond  to  the  vertical 
lines  grouped  around  120  percent.  A normal  distribution 
with  mean  of  100  percent  and  3a  equal  to  20  percent  is  also 
shown  in  the  figure. 


which  is  given  in  percent.  Values  of  loss  fraction  corre- 
sponding to  the  EPCA  nominal  efficiencies  are  plotted 
in  Fig.  1,  i.e., 

100  — Nominal  Efficiency, 

Loss  Fraction,  = iqo  - Nominal  Efficiency.  ^ 

for  j — i + 1,  i — 1,  and  z — 2.  The  index  i is  assigned  to 
the  Nominal  Efficiencies  presented  in  Table  12-8  of  the 
MG  1 standard:  It  is  a positive  integer  that  increases 
with  the  efficiency.  We  have  chosen  this  graphical  rep- 
resentation to  illustrate  the  operating  characteristics  of 
the  NOPR  and  NEMA  proposals  over  the  full  range  of 
the  EPCA  nominal  efficiencies,  and  to  give  an  indica- 
tion of  the  precision  that  underlies  the  MG  1 standard. 
The  MG  1 guidelines  establish  efficiency  levels  that 
differ  by  increments  corresponding  to  110  percent  of 
the  full-load  losses.  The  vertical  lines  grouped  around 
90  percent  and  110  percent  in  the  figure  correspond 
respectively  to  the  next  higher  and  lower  Nominal  Ef- 
ficiencies; and  the  MG  1 Minimum  Efficiencies  corre- 
spond to  the  vertical  lines  grouped  around  120  percent. 
The  values  of  loss  fraction  fall  over  a range  of  values  due 
to  rounding  in  the  least  significant  digit  in  the  efficien- 
cies given  in  Table  12-8. 
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Model  Assumptions 

Following  methods  used  by  the  NEMA,  Motor  and 
Generator  Section,  we  assume  that  motor  efficiencies 
are  normally  distributed  [5].  The  efficiency  distribu- 
tions are  thus  characterized  by  two  parameters:  the 
true  mean  efficiency  and  the  standard  deviation,  a.  Ex- 
pectation values  for  the  minimum  average  efficiencies 
may  be  clearly  established  from  the  MG  1 guidelines; 
however,  the  standard  deviation  is  not  as  clearly  de- 
fined: Since,  for  normally  distributed  efficiencies,  there 
is  a finite  probability  that  a motor  may  test  at  any  ar- 
bitrarily low  value,  there  is  no  minimum  efficiency,  per 
se. 

We  make  the  following  assumptions  for  these  calcula- 
tions: 

1.  The  efficiencies  of  units  of  a basic  model  are  nor- 
mally distributed  about  the  true  mean  efficiency, 

2.  The  true  mean  efficiency  is  equal  to  the  Nominal 
Efficiency, 

3.  The  standard  deviation  of  motor  efficiencies  is 
given  by  the  following  formula: 

Nominal  Eff.  — Minimum  Eff. 
a = , and  (1) 

4.  The  motors  tested  are  selected  at  random  from  a 
population  of  motors  that  is  representative  of  the 
motors  sold  and  in  use. 

We  infer  by  these  assumptions  that  a manufacturer  may 
reject  some  motors  due  to  low  efficiency  performance, 
and  that  the  probability  of  rejecting  a motor  on  this  ba- 
sis is  on  the  order  of  one  per  thousand.  We  believe  that 
these  conditions  approximate  a worst-case  scenario  for 
a manufacturer  following  the  MG  1 guidelines.  The 
true  distribution  of  efficiencies  would  depend  on  en- 
gineering and  business  factors  and  would  likely  differ 
between  manufacturers  and  basic  models. 

There  is  an  additional  complication  associated  with 
these  calculations  due  to  the  nature  of  testing  under 
the  NOPR:  Under  the  NOPR,  the  number  of  motors 
to  be  tested  is  not  fixed  from  the  outset.  In  the  case  of 
compliance  testing,  a manufacturer  could  test  as  few  as 
two  motors,  but  may  test  any  arbitrarily  large  nninber 
of  motors.  The  NOPR  Sampling  Plan  for  Enforcement 
Testing  specifies  an  initial  sample  of  five  but  allows 
testing  of  as  many  as  twenty  motors.  The  scenario  in 
which  the  sample  size  is  not  fixed  from  the  outset  is  dif- 
ficult to  characterize  statistically,  and  we  have  chosen 
to  treat  compliance  and  enforcement  testing  under  the 
NOPR  under  the  approximation  that  the  sample  size  is 


fixed  from  the  outset.  The  consequence  of  this  approxi- 
mation is  that  these  calculations  provide  a lower  bound 
on  the  probability  of  being  found  in  compliance.  For 
example,  a fixed  sample  size  of  five  includes  some  cases 
for  which  a manufacturer  would  have  been  shown  to  be 
in  compliance  after  testing  two  motors  and  could  have 
stopped  testing  at  that  point,  but  fails  after  testing  five 
motors  due  to  the  final  three  test  results.  The  com- 
puted probability  may  thus  underestimate  the  proba- 
bility of  being  found  in  compliance. 


Increasing  Efficiency  


Figure  2:  Model  parameter  space.  The  mean  and  standard 
deviation  are  given  as  a percentage  of  the  full-load  losses. 
The  horizontal  lines  correspond  to  the  standard  deviations 
such  that  3(j  is  equal  to  the  difference  (Nominal  Efficiency  — 
Minimum  Efficiency). 

These  model  assumptions  are  presented  graphically  in 
Fig.  2.  In  the  figure,  standard  deviations  correspond- 
ing to  the  EPCA  nominal  efficiencies  and  calculated 
by  Eq.  I are  indicated  by  horizontal  lines.  The  target 
performance  established  by  the  MG  1 guidelines  corre- 
sponds to  the  vertical  line  at  100  percent.  We  assume 
that  product  quality  control  is  maintained  such  that 
the  standard  deviations  are  at  or  below  the  band  of 
horizontal  lines. 


Compliance  testing 

Operating  characteristics  of  the  NOPR 
compliance  criteria 

The  criteria  for  establishing  compliance  with  the  ef- 
ficiency levels  mandated  by  EPCA  are  prescribed  in 
§431.24(b)(l)(iii)  of  the  NOPR  [2],  which  may  be  found 
in  Appendix  A of  this  report. 

§431.24(b)(l)(iii)  makes  reference  to  K coefficients  that 
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are  tabulated  in  Appendix  B of  Subpart  B of  the 
NOPR.  The  K coefficients  are  based  on  NEMA  Stan- 
dard MG  1-1993  [4]  and  are  calculated  by  the  following 
formula: 

Minimum  Efficiency 
Nominal  Efficiency 

The  NOPR  assigns  K coefficients  to  all  MG  1 Nominal 
Efficiencies  between  75.5  and  99.0  percent. 

To  emphasize  the  salient  features  of  the  proposal,  we 
paraphrase  the  NOPR  criteria  for  compliance  testing 
as  follows: 

Compliance  with  EPCA  efficiencies  is  demonstrated 
provided: 

(A)  The  average  full-load  efficiency  of  the  sample  is  not 
less  than  the  EPCA  nominal  efficiency,  and 

(B)  The  lower  90  percent  confidence  limit  of  the  av- 
erage full-load  efficiency  of  the  entire  population 
divided  by  the  applicable  K coefficient  is  not  less 
than  the  EPCA  nominal  efficiency. 

The  operating  characteristics  of  the  NOPR  criteria  for 
compliance  testing  are  shown  in  Eigs.  3a  and  3b,  which 
present  data  for  sample  sizes  of  two  and  five,  respec- 
tively. The  contours  plotted  are  for  the  specific  case 
where  the  EPCA  nominal  efficiency  is  80  percent,  i.e., 
K has  been  set  equal  to  0.963. 

Operating  characteristics  of  the  NEMA 
compliance  criteria 

The  full  text  of  the  NEMA  proposal  may  be  found  in 
Appendix  D of  this  report.  To  emphasize  the  salient 
features  of  the  proposal,  we  paraphrase  the  NEMA  cri- 
teria for  compliance  testing  as  follows: 

Compliance  with  EPCA  efficiencies  is  demonstrated 
provided: 

(A)  The  average  full-load  efficiency  of  a sample  of  mo- 
tors is  not  less  than  the  value  given  by  the  following 
expression, 

100 

l + l,05(^-l)’ 

and 

(B)  No  individual  motor  in  the  sample  shall  have  a 
full-load  efficiency  of  less  than  the  value  given  by 
the  following  expression, 

100 

l + 1.15(^-l)’ 
where  A'E  is  the  Nominal  Efficiency. 


Operating  characteristics  of  the  NEMA  criteria  for 
compliance  testing  are  shown  in  Fig.  4.  The  model 
calculations  shown  there  are  for  samples  of  two  and 
five. 


Enforcement  testing 

Operating  characteristics  of  the  NOPR 
sampling  plan 

The  full  text  of  the  NOPR  proposal  for  enforcement 
testing  may  be  found  in  Appendix  C of  this  report. 
The  operating  characteristics  of  the  NOPR  Sampling 
Plan  for  Enforcement  Testing  for  sample  sizes  of  five 
and  twenty  are  shown  in  Figs.  5a  and  5b,  respectively. 


Operating  characteristics  of  the  NEMA 
enforcement  criteria 

The  full  text  of  the  NEMA  proposal  for  enforcement 
testing  may  be  found  in  Appendix  D of  this  report. 
To  emphasize  the  salient  features  of  this  proposal,  we 
paraphrase  the  NEMA  criteria  for  enforcement  testing 
as  follows: 

Compliance  with  EPCA  efficiencies  is  demonstrated 
provided: 

(A)  The  average  full-load  efficiency  of  a sample  of  mo- 
tors is  not  less  than  the  value  given  by  the  following 
expression, 

100 

l + 1.15(^-l)’ 

and 

(B)  No  individual  motor  in  the  sample  shall  have  a 
full-load  efficiency  of  less  than  the  value  given  by 
the  following  expression, 

100 

1 + 1.20  (#1  - 1)  ’ 

where  NE  is  the  Nominal  Efficiency. 

The  operating  characteristic  of  the  NEMA  criteria  for 
enforcement  testing  for  a sample  sizes  of  five  and  twenty 
are  shown  in  Figs.  6a  and  6b,  respectively. 
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Concluding  remarks 

Burden  of  testing 

The  data  shown  here  indicate  that  the  NOPR  crite- 
ria for  coinphance  testing  are  indeed  inconsistent  with 
NEMA  guidelines.  Under  the  NOPR  compliance  crite- 
ria, manufacturers  are,  in  effect,  required  to  have  true 
mean  efficiencies  that  are  significantly  above  the  Nom- 
inal values.  While  the  NOPR  criteria  may  allow  min- 
imal testing  in  principle,  the  premium  paid  for  such 
reduced  testing,  in  terms  of  average  efficiency  j^erfor- 
maiice  above  the  Nominal  value,  is  severe.  Figure  3a 
suggests  that  the  true  mean  efficiency  must  lie  above 
the  next  higher  Nominal  value  for  a manufacturer  to 
have  a 90  percent  probability  of  being  found  in  compli- 
ance for  a sample  size  of  two. 

We  note  also  that  the  K coefficients  given  in  Ap- 
pendix B of  Subpart  B of  the  NOPR  [2]  include  all 
IVIG  1 Nominal  Efficiencies  equal  to  or  greater  than  the 
lowest  value  allowed  by  EPCA,  and  that  the  NOPR 
criteria  thus  establish  a protocol  for  assigning  Nomi- 
nal Efficiencies  that  applies  to  all  covered  motors.  It 
is  particularly  important  in  this  case  that  the  labeling 
protocol  established  by  the  final  rule  be  consistent  with 
the  MG  1 guidelines. 

Risk  for  over-representation  of  efficiency 

The  performance  of  the  NEMA  proposal  in  deterring 
over-represented  values  of  efficiency  should  be  consid- 
ered. The  model  calculations  presented  in  Fig.  4b  sug- 
gest that  the  probability  of  being  found  in  compliance 
by  testing  five  motors  under  the  NEMA  protocol  is  on 
the  order  of  90  percent  to  95  percent  and  that  the  prob- 
ability of  compliance  decreases  substantially  for  true 
mean  efficiencies  that  are  below  EPCA  nominal  effi- 
ciencies. However,  a full  evaluation  of  the  deterrence 
against  over-represented  efficiencies  may  require  cost- 
benefit  analyses,  which  is  beyond  the  scope  of  this  re- 
port. 

Our  conclusions  regarding  the  performance  of  the 
NEMA  compliance  criteria  in  deterring  systematic 
over-representation  of  efficiencies  would  be  much  dif- 
ferent, had  we  assumed  product  quality  control  sup- 
porting a smaller  standard  deviation: 

6(7  « Nominal  Efficiency  — Minimum  Efficiency 

for  example.  The  NEMA  criteria  could  be  fine-tuned 
to  more  strongly  favor  higher  efficiencies:  the  1.05  coef- 
ficient could  be  changed  to  1.03,  for  example.  However, 
to  our  knowledge,  the  DOE  has  no  data  to  suggest  that 
the  NEMA  proposal  provides  a realistic  advantage  for 
systematic  over-representation  of  efficiencies. 


Table  1:  t coefficients  for  si)ecified  confidence.  Adapted 
from  ASTM  Standard  E 122-89 


t value 

Confidence 

Probability  of 
exceeding  E 

3 

99.7 

0.003 

2. 56 

99.0 

0.010 

2 

95.5 

0.045 

1.96 

95.0 

0.050 

1.64 

90.0 

0.100 

Sample  size  under  the  NEMA  compli- 
ance criteria 

We  note,  as  may  be  readily  verified  by  examination  of 
the  data  shown  in  Fig.  4,  that  the  performance  of  the 
NEMA  proposal  for  compliance  testing  depends  on  the 
sample  size.  We  believe  that  compliance  testing  for 
the  purpose  of  substantiation  of  an  AEDM  provides 
the  most  compelling  argument  for  establishing  a min- 
imum sample  size.  The  criteria  for  substantiation  of 
an  AEDAl  are  provided  in  §431. 24(b)  (3)  of  the  NOPR, 
which  is  reproduced  in  Appendix  B of  this  report.  Sub- 
stantiation of  an  AEDM  is  based  on  compliance  testing; 
and  the  results  of  such  testing  may  be  highly  leveraged, 
in  that  testing  as  few  as  five  basic  models  may  provide 
the  basis  for  labeling  a substantial  portion  of  a niaiiu- 
facturer’s  line  of  covered  motors.  The  DOE  thus  has 
an  interest  in  establishing  the  validity  of  such  test  re- 
sults. The  following  discussion  estimates  the  number 
of  tests  needed  to  support  the  recpiired  10  percent  pre- 
cision recommended  by  the  NOPR. 

The  scenario  in  which  testing  is  required  to  conform  to 
a predetermined  precision  is  addressed  by  ASTM  Stan- 
dard E122-89  [7].  This  standard  is  based  on  use  of  the 
t statistic  and  establishes  the  sample  size  required  to 
determine  a two-sided  confidence  interval  for  an  esti- 
mate of  the  mean.  The  sample  size,  n,  is  given  by  the 
following  expression: 


where  E is  the  required  tolerance  and  t is  the  coefficient 
that  corresponds  to  the  desired  statistical  confidence 
(see  Table  1).  In  this  case,  the  desired  tolerance,  E,  is 
10%  of  the  total  loss,  i.e., 

E = 0.10(100  - NE). 

Assume  that  the  difference  between  the  NEMA  Nomi- 
nal and  Minimum  efficiencies  corresponds  to  three  stan- 
dard deviations,  and  use  the  approximation, 

0.20(100  - NE) 
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for  the  standard  deviation.  Finally,  since  a high  statis- 
tical conhdence  is  desired,  set  the  coefficient  t equal  to 
three.  Substitution  of  these  values  into  Eq.  2 gives  the 
following  expression  for  sample  size: 

_ '3  X 0.20(100-  A^E)1“ 

“ [3  X 0.10(100- A^E)_  ■ 

From  this  we  can  conclude  that  no  fewer  than  four  mo- 
tors should  be  tested. 

Harmonization  of  compliance  and  en- 
forcement testing 

The  NEMA  proposal  presents  motor  testing  criteria  for 
compliance  and  enforcement  that  are  closely  related. 
While  it  may  be  desirable  to  harmonize  such  compli- 
ance and  enforcement  testing,  the  NEMA  criteria  for 
enforcement  testing  may  have  unwanted  characteris- 
tics. 

1.  The  NEMA  criteria  for  enforcement  testing  appear 
to  make  little  distinction  between  performance  at 
and  significantly  below  the  EPCA  levels:  the  data 
presented  in  Fig.  6a  suggest  that  the  true  mean 
efficiency  could  be  near  the  next  lower  Nominal 
value  without  an  appreciable  change  in  the  out- 
come of  enforcement  testing.  Thus,  it  may  be  ar- 
gued that  the  NEMA  enforcement  crtieria  do  not 
adequately  support  the  EPCA  goals. 

2.  Although  interrelated,  compliance  and  enforce- 
ment testing  differ  in  significant  ways.  For  ex- 
ample, the  consequences  that  may  follow  failure 
to  pass  an  enforcement  test  cannot  be  foreseen  by 
the  rule.  Under  the  NEMA  criteria,  the  efficiency 
performance  of  a single  unit  could  cause  a basic 
model  to  fail  the  entire  test,  without  recourse.  The 
NEMA  criteria  may  thus  not  allow  a manufacturer 
to  test  as  needed  to  protect  its  interests. 

Performance  of  the  NOPR  Sampling 
Plan  for  Enforcement  Testing 

One  important  characteristic  for  evaluating  the  perfor- 
mance of  the  Sampling  Plan  for  Enforcement  Testing  is 
the  likelihood  that  testing  could  support  a false  conclu- 
sion. As  proposed,  the  Sampling  Plan  for  Enforcement 
Testing  establishes  that  testing  be  consistent  with  a sta- 
tistical confidence  of  not  less  that  90  percent.  This  sta- 
tistical confidence  implies  that  the  likelihood  of  falsely 
concluding  that  a product  is  not  in  compliance  may  be 
as  high  as  10  percent.  This  level  of  assurance  may  not 
adequately  protect  the  manufacturer’s  interests.  The 
NOPR  Sampling  Plan  for  Enforcement  Testing  could 


be  readily  modified  to  increase  the  assurance  against  a 
false  conclusion. 

This  modification  could  be  accomplished  by  a change 
in  the  wording  of  Step  5 of  the  NOPR  Sampling  Plan 
for  Enforcement  Testing.  The  text  could  be  changed  to 
read  as  follows: 

Compute  the  lower  control  limit  [LCLi)  for 
the  mean  of  the  first  sample  using  the  appli- 
cable statutory  full-load  efficiency  (SFE)  as 
the  desired  mean  as  follows: 

LCLi  ^ SFE  -tSE{Xi). 

Here  t is  the  1 percentile  of  a t-distribution 
for  a sample  size  of  ni  and  yields  a ^ percent 
confidence  level  for  a one-tailed  t-test, 

where  the  modified  text  has  been  underlined. 

In  principle,  specifying  a higher  statistical  confidence 
may  require  a higher  level  of  testing.  To  estimate  the 
level  of  testing  required,  we  estimate  the  likelihood  that 
a motor  that  is  labeled  in  accordance  with  the  MG  1 
guidelines  would  fail  during  enforcement  testing  due  to 
insufficient  sample  size.  Step  7 of  the  NOPR  Sampling 
Plan  for  Enforcement  Testing  sets  a condition  on  the 
sample  size.  To  demonstrate  compliance,  the  initial 
sample  size,  rii , must  satisfy  the  following  condition: 

rt5i(120-0.25FE)1- 
- [SEE{20-0.2SEE)\  ’ ^ ’ 

where  SEE  is  the  applicable  EPCA  nominal  efficiency 
and  Fi  is  the  standard  deviation  of  the  sample.  This 
equation  may  be  rearranged  to  yield  a condition  on  the 
value  of  t: 

^ l^SEE{20-0.2SEE)-\ 

-[  5i(120-  0.25FF) 

Eollowing  the  earlier  discussion,  one  can  assume  that 
the  difference  between  the  NEMA  Nominal  and  Mini- 
mum efficiencies  corresponds  to  three  standard  devia- 
tions, and  use  the  following  approximation: 

^ _ (7  _ 0.20(100-  5FF) 

^ ynT  3yT?T 

Upon  substitution  into  Eq.  4,  the  following  condition 
on  t is  obtained: 

5FF(20  - 0.205FF) 

0.20(100 - 5FF)(120-  0.25FF)' 

Eor  an  initial  sample  of  five,  t must  exceed  ten  for 
the  sample  to  fail  due  to  insufficient  sample  size  for 
all  EPCA  nominal  efficiencies.  The  probability  that  t 
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would  exceed  ten  by  chance  is  less  than  1 in  1000,  for 
a sample  of  hve.  We  conclude  that  it  is  highly  unlikely 
that  a product  that  is  labeled  in  accordance  with  the 
MG  1 guidelines  would  require  testing  beyond  the  ini- 
tial sample  of  five,  and  argue  that  any  risk  of  additional 
testing  is  more  than  offset  by  the  increased  value  of  the 
test  in  assuring  that  the  manufacturer’s  interests  are 
protected. 

The  operating  characteristics  of  the  modified  Sampling 
Plan  for  Enforcement  Testing  are  shown  in  Fig.  7. 
The  hgure  presents  data  for  initial  samples  of  hve  and 
twenty. 

Summary 

In  this  section,  we  summarize  the  relative  merits  of  each 
set  of  criteria. 

Compliance  testing 
NOPR  criteria 

Advantages: 

• high  assurance  that  the  average  motor  ef- 
hciency  meets  or  exceeds  EPCA  levels  with 
minimal  testing 

• the  likelihood  of  a correct  determination  in- 
creases with  sample  size 

Disadvantages: 

• high  burden  on  manufacturers,  i.e.,  the  risk 
of  a false  determination  of  noncompliance  can 
be  as  high  as  50  percent 

• complexity 

• statistical  methods  that  describe  these  crite- 
ria are  not  readily  available 


Enforcement  testing 
NOPR 

Advantages: 

• robust,  i.e.,  the  t-test  is  not  strongly  inhu- 
enced  by  the  exact  form  of  the  underlying 
distribution  and  it  is  a widely  accepted  ba- 
sis for  a testing  protocol 

• the  likelihood  of  a correct  determination  in- 
creases with  sample  size 

Disadvantages: 

• complexity 

NEMA  criteria 

Advantages: 

• simplicity 

Disadvantages: 

• these  test  criteria  do  not  appear  to  differen- 
tiate between  efficiencies  at  and  signihcantly 
below  the  EPCA  nominal  values 

• statistical  methods  are  not  readily  available 


NEMA  criteria 

Advantages: 

• simplicity 

• reduced  burden  on  manufacturers 
Disadvantages: 

• higher  risk,  relative  to  the  NOPR  criteria,  of 
overly  optimistic  estimates  of  efficiency 

• statistical  methods  that  describe  these  crite- 
ria are  not  readily  available 
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a) 


b) 


Increasing  Efficiency 


Increasing  Efficiency 


Loss  Fraction  (Percent  of  Full-Load  Losses) 


Figure  3:  Operating  characteristics  of  the  NOPR  compliance  criteria.  Model  calculations  for  samples  of  two  and  five 
motors  are  shown  in  a)  and  b),  respectively.  The  contours  indicate  the  probability  of  demonstrating  compliance,  e.g.,  the 
.90  contour  corresponds  to  a 90  percent  likelihood  of  demonstrating  compliance. 
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Increasing  Efficiency 


Increasing  Efficiency 


Loss  Fraction  (Percent  of  Full-Load  Losses) 

Figure  4:  Operating  characteristics  of  the  NEMA  criteria  for  compliance  testing.  Model  calculations  for  samples  of  two 
and  five  are  shown  in  a)  and  b),  respectively.  The  contours  indicate  the  probability  of  demonstrating  compliance,  e.g.. 
the  .90  contour  corresponds  to  a 90  percent  likelihood  of  demonstrating  compliance. 
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Increasing  Efficiency 


Increasing  Efficiency 


Figure  5:  Operating  characteristics  of  the  NOPR  proposal  for  enforcement  testing.  Model  calculationds  for  samples  of 
five  and  twenty  are  shown  in  a)  and  b),  respectively. 
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Loss  Fraction  (Percent  of  Full-Load  Losses) 


Figure  6:  Operating  characteristics  of  the  NEMA  criteria  for  enforcement  testing.  Model  calculations  for  sample  sizes 
of  five  and  twenty  are  shown  in  a)  and  b),  respectively.  The  i)roba.bilities  of  being  found  in  compliance  are  indicated  by 
the  contours,  e.g.,  the  contour  labeled  .90  corresponds  to  a 90  percent  probability  of  being  shown  in  comi)liance. 
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Increasing  Efficiency 


Increasing  Efficiency 


Loss  Fraction  (Percent  of  Full-Load  Losses) 


Figure  7:  Operating  characteristics  of  the  NOPR  proposal  for  enforcement  testing  at  99  percent  confidence.  Model 
calculations  for  sample  sizes  of  five  and  twenty  are  shown  in  a)  and  b)  respectively.  The  contours  indicate  the  probability 
of  being  shown  in  compliance,  i.e.,  the  contour  labeled  .90  corresponds  to  a 90  percent  probability  of  being  found  in 
compliance. 
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Appendix  A 


NOPR — Compliance  Criteria 


The  criteria  for  establishing  compliance  with  the  efficiency  levels  mandated  by  EPCA  are  prescribed  in 
§431.24(b)(l)(iii)  of  the  NOPR  [2], 

§431.24(b)(l)(iii)  makes  reference  to  K coefficients  that  are  tabulated  in  Appendix  B of  Subpart  B of  the  NOPR. 
The  K coefficients  are  based  on  NEMA  Standard  MG  1-1993  [4]  and  are  calculated  by  the  following  formula: 

NEMA  Minimum  Efficiency 
NEMA  Nominal  Efficiency 

The  table  assigns  K coefficients  to  all  MG  1 Nominal  Efficiencies  between  75.5  percent  and  99.0  percent. 

§431.24{b)(l)(iii) 

Eor  each  basic  model  selected  for  testing,  a sample  of  units  shall  be  selected  at  random  and  tested  in 
accordance  with  §§431.23  and  431.25,  and  Appendix  A,  of  this  subpart.  The  sample  shall  be  comprised  of 
production  units  of  the  basic  model,  or  units  that  are  representative  of  such  production  units,  and  shall  be 
of  sufficient  size  to  ensure  that  any  represented  value  of  the  nominal  or  average  full-load  efficiency  of  the 
basic  model  is  no  greater  than  the  lesser  of 

(A)  The  average  full-load  efficiency  of  the  sample,  or 

(B)  The  lower  90  percent  confidence  limit  of  the  average  full-load  efficiency  of  the  entire  population  divided 
by  the  coefficient  “K”  applicable  to  the  represented  value.  The  coefficients  are  set  forth  in  appendix  B 
of  this  subpart. 
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Appendix  B of  Subpart  B of  Part  431 — Nominal  Full-load  Efficiency  and  Corre- 
sponding Coefficient  K 


Nominal  full-load 
efRciencv 

Coefficient  K 

Nominal  full-load 
efficiency 

Coefficient  K 

99.0 

0.998 

94.1 

0.988 

98.9 

0.998 

93.6 

0.987 

98.8 

0.998 

93.0 

0.986 

98.7 

0.998 

92.4 

0.985 

98.6 

0.998 

91.7 

0.984 

98.5 

0.997 

91.0 

0.984 

98.4 

0.996 

90.2 

0.981 

98.2 

0.996 

89.5 

0.978 

98.0 

0.996 

88.5 

0.977 

97.8 

0.996 

87.5 

0.977 

97.6 

0.995 

86.5 

0.971 

97.4 

0.994 

85.5 

0.965 

97.1 

0.994 

84.0 

0.970 

96.8 

0.994 

82.5 

0.970 

96.5 

0.993 

81.5 

0.963 

96.2 

0.992 

80.0 

0.963 

95.8 

0.992 

78.5 

0.962 

95.4 

0.991 

77.0 

0.961 

95.0 

0.990 

75.5 

0.954 

94.5 

0.990 
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NOPR — AEDM  Substantiation 


Criteria  for  substantiation  of  an  AEDM  are  provided  in  §431. 24(b)(3)  of  the  NOPR  [2]. 


§431.24(b)(3) 

Substantiation  of  an  alternative  efficiency  determination  method.  Before  an  AEDM  is  used,  its  accuracy 
and  reliability  must  be  substantiated  as  follows: 

(i)  The  AEDM  must  be  applied  to  at  least  five  basic  models  that  have  been  selected  for  testing  and  tested 
in  accordance  with  paragraph  (b)(1)  of  this  section,  and 

(ii)  The  predicted  total  power  loss  for  each  basic  model,  calculated  by  applying  the  AEDM,  must  be  within 
plus  or  minus  ten  percent  of  the  mean  total  power  loss  determined  from  the  actual  testing  of  the  basic 
model. 
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NOPR — Sampling  Plan  for  Enforcement  Testing 


The  Sampling  Plan  for  Enforcement  Testing  proposed  by  the  NOPR  [2], 


Appendix  B to  Subpart  G of  Part  431 — Sampling  Plan  for  Enforcement  Testing 

Step  1.  The  first  sample  size  (7?i)  must  be  five  or  more  units. 

Step  2.  Compute  the  mean  (Ai)  of  the  measured  energy  performance  of  the  rii  units  in  the  first  sample  as 
follows: 


1 ^ 

v.  = ^ y:  A-,, 

ni 

i=l 


(Cl) 


where  Xj  is  the  measured  full-load  efficiency  of  unit  i. 


Step  3.  Compute  the  sample  standard  deviation  (5i)  of  the  measured  full-load  efficiency  of  the  iii  units  in 
the  first  sample  as  follows: 


5i  = 


ni  - 1 


(C2) 


Step  4.  Compute  the  standard  error  {SE{Xi))  of  the  mean  full-load  efficiency  of  the  first  sample  as  follows: 

5i 


SE{X: 


(C3) 


Step  5.  Compute  the  lower  control  limit  {LCLi)  for  the  mean  of  the  first  sample  using  the  applicable 
statutory  full-load  efficiency  {SEE)  as  the  desired  mean  as  follows: 


LCLi  = SEE  -tSE{Xi).  (C4) 

Here  t is  the  10th  percentile  of  a f-distribution  for  a sample  size  of  Jii  and  yields  a 90  percent 
confidence  level  for  a one-tailed  f-test. 

Step  6.  Compare  the  mean  of  the  first  sample  (A'l)  with  the  lower  control  limit  [LCLi)  to  determine  one 
of  the  following: 

(i)  If  the  mean  of  the  first  sample  is  below  the  lower  control  limit,  then  the  Ijasic  model  is  in 
noncompliance  and  testing  is  at  an  end. 

(ii)  If  the  mean  is  equal  to  or  greater  than  the  lower  control  limit,  no  final  determination  of 
compliance  or  noncompliance  can  be  made;  proceed  to  Step  7. 

Step  7.  Determine  the  recommended  sample  size  (n)  as  follows: 

■f5i(120-0.25FE) 

“ [5FF(20-  0.25FF) 

where  5i  and  t have  the  values  used  in  Steps  4 and  5,  respectively.  The  factor 

120  - 0.25FF 
5FF(20  - 0.25FF) 

is  based  on  a 20  percent  tolerance  in  the  total  power  loss  at  full-load  and  fixed  output  power. 

Given  the  value  of  n,  determine  one  of  the  following: 


(C5) 
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(i)  If  the  value  of  n is  less  than  or  equal  to  rii  and  if  the  mean  energy  efficiency  of  the  first  sample 
(Xi)  is  equal  to  or  greater  than  the  lower  control  limit  (LCLi),  the  basic  model  is  in  compliance 
and  testing  is  at  an  end. 

(ii)  If  the  value  of  n is  greater  than  7?i,  the  basic  model  is  in  noncompliance.  The  size  of  a second 
sample  no  is  determined  to  be  the  smallest  integer  equal  to  or  greater  than  the  difference  n — rii. 
If  the  value  of  no  so  calculated  is  greater  than  20  — ni,  set  Jio  equal  to  20  — ni. 

Step  8.  Compute  the  combined  mean  (X2)  of  the  measured  energy  performance  of  the  ni  and  no  units  of 
the  combined  hrst  and  second  samples  as  follows: 


AT 


1 


77-1  + no 


ni  +712 

E A-.. 


i=l 


(C6) 


Step  9.  Compute  the  standard  error  {SE{X2))  of  the  mean  full-load  efficiency  of  the  77i  and  772  units  in  the 
combined  first  and  second  samples  as  follows: 


SE{Xo) 


Si 

^71 1 + no 


(C7) 


(Note  that  Si  is  the  value  obtained  above  in  Step  3.) 
Step  10.  Set  the  lower  control  limit  {LCLo)  to, 


LCLo  = SEE  - tSE{Xo),  (C8) 

wffiere  t has  the  value  obtained  in  Step  5,  and  compare  the  combined  sample  mean  (A2)  to  the  lower 
control  limit  [LCLo]  to  find  one  of  the  following: 

(i)  If  the  mean  of  the  combined  sample  (A2)  is  less  than  the  lower  control  limit  {LCL-j)-,  the  basic 
model  is  in  noncompliance  and  testing  is  at  an  end. 

(ii)  If  the  mean  of  the  combined  sample  (A2)  is  equal  to  or  greater  than  the  lower  control  limit 
{LCLo),  the  basic  model  is  in  compliance  and  testing  is  at  an  end. 


MANUFACTURER-OPTION  TESTING 

If  a determination  of  non-compliance  is  made  in  Steps  6,  7 or  11,  above,  the  manufacturer  may  request  that 
additional  testing  be  conducted,  in  accordance  with  the  followdng  procedures. 

Step  A.  The  manufacturer  requests  that  an  additional  number,  773,  of  units  be  tested,  with  773  chosen  such 
that  77-1  -f-  no  -I-  773  does  not  exceed  20. 

Step  B.  Compute  the  mean  full-load  efficiency,  standard  error,  and  lower  control  limit  of  the  new  combined 
sample  in  accordance  with  the  procedures  prescribed  in  Steps  8,  9,  and  10,  above. 

Step  C.  Compare  the  mean  performance  of  the  new  combined  sample  to  the  lower  control  limit  {LCL2)  to 
determine  one  of  the  following: 

(a)  If  the  new  combined  sample  mean  is  equal  to  or  greater  than  the  lower  control  limit,  the  basic 
model  is  in  compliance  and  testing  is  at  an  end. 

(b)  If  the  new  combined  sample  mean  is  less  than  the  lower  control  limit  and  the  value  of  77-1  -f  772 +773 
is  less  than  20,  the  manufacturer  may  request  that  additional  units  be  tested.  The  total  of  all 
units  tested  may  not  exceed  20.  Steps  A,  B,  and  C are  then  repeated. 

(c)  Otherwise,  the  basic  model  is  determined  to  be  in  noncompliance. 
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The  NEMA  Proposal 


The  following  statement  was  prepared  by  the  NEMA,  Motor  and  Generator  Section,  and  was  submitted  to  the 
DOE  on  Eriday,  April  18,  1997,  in  response  to  the  call  public  comment  given  in  the  NOPR  [2],  The  text  of  the 
original  NEMA  statement  [3]  has  been  modified  to  conform  with  the  pagination  and  the  figure  labeling  scheme 
used  in  this  report. 

PROPOSAL  FOR  THE  METHOD  OF  DETERMINING  COMPLIANCE  AND 
ENFORCEMENT  FOR  ELECTRIC  MOTORS  UNDER  THE  EFFICIENCY  LABELING 

PROGRAM  OF  DOE  10  CFR  PART  431 
Submitted  by 

NEMA  Motor  and  Generator  Section 


Background  - Analysis  of  Testing  Samples  from  Total  Population 

The  basis  behind  the  NEMA  proposal  is  best  illustrated  by  way  of  examples.  A normal  distribution  for  a total 
population  of  motors  having  a nominal  efficiency  rating  of  91.0%  is  shown  in  Figure  D1  based  on  the  assumption 
that  three  sigma  (standard  deviation)  corresponds  to  the  NEMA  minimum  efficiency  of  89.5%.  Also  shown  are 
the  normal  distributions  for  the  means  of  samples  of  size  2 or  five  which  are  normally  distributed  about  the  true 
mean  of  the  population  and  have  a standard  deviation  proportional  to  that  of  the  total  population  divided  by 
the  square  root  of  the  sample  size  n.  The  normal  distribution  of  the  total  population  also  corresponds  to  the 
distribution  of  the  means  of  samples  of  size  1. 

Per  Table  12-8  of  NEMA  MG  1 the  values  of  efficiency  in  the  vicinity  of  91.0%  which  a manufacturer  can  mark  on 
appropriately  rated  motors  are  89.5%,  90.2%,  91.0%,  91.7%,  and  92.4%.  It  remains  to  be  determined  which  level 
of  efficiency  is  supported  by  testing  samples  selected  from  the  total  population.  For  this  example,  a reasonable 
compliance  criteria  should  show  that  the  nominal  efficiency  is  91.0%  within  a desired  degree  of  confidence. 

Figure  D2  illustrates  the  probability  that  the  mean  of  a sample  selected  from  the  total  population  will  be  less 
than  various  levels  of  efficiency.  The  DOE  proposed  rule  for  compliance  in  431.24.b.l.iii.A  recjuires  that  the 
represented  value  of  nominal  efficiency  for  the  basic  model  (total  population)  cannot  be  greater  than  the  average 
(mean)  full-load  efficiency  of  the  sample.  From  Figure  D2  it  can  be  seen  that  there  is  a probability  of  50% 
that  the  mean  efficiency  of  a sample  of  any  size  will  be  less  than  the  nominal  efficiency  of  the  total  population, 
91.0%  in  this  particular  example.  Combining  this  DOE  proposed  rule  with  the  NEjMA  Standard  for  selection 
of  efficiency  levels  for  marking,  tliere  is  then  a probability  of  50%  that  for  any  sample  selected  from  the  total 
population  the  declared  value  of  nominal  efficiency  could  not  be  greater  than  90.2%.  From  Figure  D2  the 
probability  that  the  mean  of  the  sample  would  actually  be  less  than  90.2%  and  that  the  nominal  efficiency  must 
be  selected  to  be  the  next  lower  value,  89.5%,  is  5%  for  a sample  of  1,  1.2%  for  a sample  of  2,  and  a negligible 
value  for  a sample  of  5.  It  should  be  apparent  that  the  DOE  proposed  rule  places  an  unreasonable  burden  (risk) 
on  the  manufacturer  to  show  compliance  to  the  actual  true  mean  nominal  efficiency.  A rule  based  on  the  average 
efficiency  of  a sample  not  being  less  than  some  efficiency  level  lower  than  the  nominal  efficiency,  91.0%  in  this 
example,  would  appear  to  offer  a reasonable  risk  for  the  manufacturer  to  show  compliance  to  91.0%. 

Background  - Analysis  of  Testing  Samples  from  Limited  Population 

Because  motors  based  on  a basic  model  design  are  produced  over  a long  period  of  time,  the  total  population  for 
which  compliance  is  being  determined  will  not  be  available  at  the  time  a sample  must  be  selected  for  testing.  As 
a result,  the  sample  will  be  selected  from  production  lot(s)  which  may  incorporate  a limited  range  of  variation  of 
all  of  the  factors  which  can  affect  the  efficiency  of  each  individual  motor;  the  variations  in  materials,  variations  in 
manufacturing  processes,  and  variations  in  testing  (see  NEMA  MG  1-12.58.2).  It  is  not  possible  to  include  in  a 
compliance  rule,  when  testing  is  likely  to  take  place  in  only  one  location,  the  allowance  in  the  NEMA  standard  for 
the  variation  in  testing  results  when  a motor  is  tested  at  different  locations.  It  is  then  reasonable  to  assume  that 
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if  the  distribution  of  efficiencies  of  the  total  population  tested  at  any  facility  are  as  shown  in  Figure  D1  then  the 
distribution  of  the  total  population  when  tested  at  a single  facility  must  have  a lower  value  of  standard  deviation. 
Further,  it  should  be  evident  that  the  standard  deviation  of  any  particular  limited  production  lot  should  be  even 
lower  because  it  will  not  incorporate  all  of  the  possible  variations  in  materials  and  manufacturing  processes  that 
can  occur  over  the  extended  period  of  time  the  basic  model  is  produced.  For  example,  the  electrical  steel  used  to 
construct  the  stator  and  rotor  laminated  cores  is  purchased  in  large  quantities  at  a time.  The  amount  purchased 
may  be  sufficient  to  handle  the  production  of  motors  for  several  months.  The  characteristics  of  the  material  in 
that  stock  will  determine  the  efficiency  in  the  motors  selected  for  testing  from  those  produced  using  that  stock. 
A new  stock  of  material  having  somewhat  different  performance  characteristics  will  not  be  available  for  use  until 
the  present  stock  is  depleted. 

For  the  purpose  of  this  illustration,  it  will  be  assumed  that  the  processes  under  the  manufacturer’s  control 
limit  the  minimum  efficiency  for  any  acceptable  motor  to  89.8%.  The  difference  between  89.8%  and  the  NEMA 
minimum  efficiency  of  89.5%  allows  for  variations  in  the  test  value  of  efficiency  when  the  tests  are  performed  at 
facilities  not  under  the  direction  of  the  manufacturer.  It  will  be  further  assumed  that  the  mean  efficiency  of  the 
limited  population  is  equal  to  90.6%  as  a result  of  the  effect  of  variations  in  materials,  manufacturing  processes, 
and  testing  performed  at  a single  facility.  The  difference  between  efficiencies  of  91.0%  and  90.6%  is  equivalent 
to  a reasonable  variation  of  5%  in  the  total  losses.  A normal  distribution  on  the  basis  of  these  assumptions  is 
shown  in  Figure  D3.  Included  are  the  normal  distributions  of  the  means  of  samples  of  size  2 and  5 as  well  as 
1.  From  Figure  D2  it  can  also  be  observed  that  the  probability  of  a production  lot  of  motors  having  a mean 
efficiency  less  than  90.6%  is  21%. 

The  probability  distribution  function  for  the  limited  population  in  Figure  D3  is  shown  in  Figure  D4.  From 
Figure  D4  the  probability  that  a sample  mean  would  exceed  91.0%  is  only  8%  for  a sample  of  1,  2%  for  a sample 
of  2,  and  0%  for  a sample  of  5.  In  other  words,  a sample  taken  from  such  a limited  population,  even  if  the 
number  of  motors  was  in  the  hundreds  or  thousands,  would  be  unlikely  to  support  compliance  to  the  correct 
true  mean  of  the  total  population  when  following  DOE’s  proposed  rule. 

This  example  does,  however,  provide  additional  guidance  as  to  what  the  compliance  rule  could  be.  From 
Figure  D4  there  is  a probability  of  90%  that  the  mean  efficiency  of  a sample  from  this  limited  lot  size  will  be 
greater  than  90.25%  for  a sample  of  1,  90.35%  for  a sample  of  2,  or  90.44%  for  a sample  of  5.  From  Figure  D2 
for  the  total  population  there  is  a probability  of  93%  that  any  motor  from  the  total  population  has  an  efficiency 
greater  than  90.25%,  a probability  of  90%  that  any  motor  will  have  an  efficiency  greater  than  90.35%,  or  a 
probability  of  87%  that  any  motor  would  have  an  efficiency  of  90.44%. 


Background  - Overlapping  Nominal  Efficiency  Distributions 

The  final  criteria  which  must  be  examined  for  determining  a practical  compliance  rule  is  the  probability  that 
the  sample  test  may  indicate  an  incorrect  nominal  efficiency  for  the  basic  model  (total  population).  To  aid 
in  the  discussion  of  this  issue.  Figure  D5  is  presented  which  illustrates  the  normal  distribution  of  efficiencies 
for  a population  of  motors  which  have  a nominal  efficiency  of  91.0%  and  a population  of  motors  which  have  a 
nominal  efficiency  of  90.2%.  In  this  case  90.2%  is  the  next  lower  level  of  nominal  efficiency  which  the  NEMA 
MG  1 Standard  permits  to  be  used  for  the  marking  of  motors.  Again,  distributions  based  on  test  samples  of 
sizes  1 (equivalent  to  the  distribution  for  the  total  population),  2,  and  5 are  provided  for  each  population.  The 
corresponding  probability  distributions  are  shown  in  Figure  D6. 

From  Figure  D5  it  can  be  observed  that  the  various  distributions  of  efficiency  of  the  two  populations  tend  to 
intersect  each  other  in  the  region  of  an  efficiency  of  90.6%.  This  varies  slightly  based  on  the  sample  sizes  because 
of  the  difference  in  the  NEMA  criteria  permitted  for  the  two  nominal  efficiency  levels.  For  a nominal  efficiency 
of  91.0%  the  NEAIA  minimum  efficiency  is  89.5%  for  a standard  deviation  of  0.5%.  For  a nominal  efficiency  of 
90.2%  the  NEMA  minimum  efficiency  is  88.5%  for  a standard  deviation  of  0.57%.  This  slight  distortion  in  the 
relationships  of  the  distribution  functions  is  a result  of  basing  the  curves  on  efficiency  when  in  fact  the  NEMA 
criteria  for  selecting  discreet  values  of  nominal  efficiency  for  the  use  in  marking  motors  was  based  on  step  changes 
in  the  total  losses.  The  increase  in  losses  in  going  from  an  efficiency  of  91.0%  to  89.5%  is  19.6%.  The  increase 
in  losses  is  18.6%  when  going  from  an  efficiency  of  90.2%  to  88.5%.  This  slight  difference  in  the  change  in  losses 
was  introduced  by  rounding  off  the  nominal  efficiency  values  used  for  marking  motors  to  3 significant  figures. 
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Per  Figure  D6  the  probability  that  a motor  from  a population  with  a nominal  efhciency  of  91.0%  would  have 
an  efficiency  below  90.6%  is  21%.  The  probability  that  a motor  from  a population  with  a nominal  efficiency  of 
90.2%  would  have  an  efficiency  above  90.6%  is  24%.  There  is  a probability  of  13%  that  the  mean  of  a sample 
of  size  2 selected  from  the  population  with  a nominal  efficiency  of  91.0%  would  be  less  than  90.6%.  Similarly 
there  is  a probability  of  16%  that  the  mean  of  a sample  of  size  2 selected  from  the  population  with  a nominal 
efficiency  of  90.2%  would  be  greater  than  90.6%.  There  is  a probability  of  4%  that  the  mean  of  a sample  of  size 
5 selected  from  the  population  with  a nominal  efficiency  of  91.0%  would  be  less  than  90.6%.  Similarly  there  is 
a probability  of  6%  that  the  mean  of  a sample  of  size  5 selected  from  the  population  with  a nominal  efficiency 
of  90.2%  would  be  greater  than  90.6%. 

This  suggests  that  a reasonable  criteria  for  the  compliance  rule  that  balances  the  manufacturer’s  and  consumer’s 
risks  is  that  the  minimum  permissible  value  of  average  efficiency  for  the  sample  should  be  a value  between  the 
nominal  efficiency  to  be  declared  and  the  next  lower  value  of  nominal  efficiency  in  Table  12-8  of  NEMA  MG  1. 


Proposed  Test  for  Determining  Compliance  (Section  431.24.b.l.iii  of  Part  431) 

Basing  the  test  condition  for  compliance  on  the  values  of  nominal  efficiency  in  Table  12-8  would  introduce  a 
complexity  of  having  to  use  a table  of  values  in  which  the  increment  in  efficiency  between  values  is  not  hxed.  It 
is  simpler  to  use  the  basic  principle  under  which  the  table  was  developed.  This  is  the  same  principle  that  the 
DOE  recognized  in  the  proposed  rule  for  enforcement  testing  in  Appendix  B to  Subpart  G of  Part  431.  The 
increment  in  efficiency  between  the  nominal  values  in  Table  12-8  were  based  on  approximately  a 10%  change 
in  total  losses.  The  point  at  which  the  manufacturer’s  and  consumer’s  risks  are  balanced  between  two  NEMA 
nominal  \'alues  of  efficiency  suggested  above  corresponds  to  a 5%  change  in  losses. 

It  is  therefore  proposed  that  one  of  the  conditions  required  to  determine  conformance  is  that  the  “average  full- 
load  efficiency  of  the  sample  is  not  less  than  the  value  of  efficiency  equal  to  the  nominal  efficiency  reduced  by 
an  amount  equivalent  to  a 5%  increase  in  losses  at  full-load,  i.e.  the  value  given  by 

100 

1 + 1.05(^-1) 

This  proposal  could  also  be  written  in  a manner  consistent  with  the  DOE  proposed  rule  431.24.b.l.iii.A  “as  the 
represented  value  of  the  nominal  full-load  efficiency  of  the  basic  model  is  not  greater  than  the  value  calculated 
from 

105T 

100  + 0.05A' 

where  A'  is  the  average  full-load  efficiency  of  the  sample.” 

The  second  condition  that  must  be  satisfied  by  the  sample  is  related  to  the  standard  deviation  of  the  efficiencies 
of  the  motors  in  the  sample.  In  Appendix  B to  Subpart  G of  Part  431  the  DOE  proposed  a test  on  the  sample 
size  based  on  a 20  percent  tolerance  in  the  total  power  loss  at  full-load.  This  recognizes  the  complete  variation 
in  efficiency  testing  at  different  facilities  as  identihed  in  the  NEMA  MG  1 standard.  It  is  recommended  that 
this  value  of  20%  can  be  reduced  to  15%  for  the  purpose  of  compliance  testing  at  a single  facility.  The  principle 
behind  the  incorporation  of  this  recognized  variation  in  Appendix  B to  Subpart  G of  Part  431  can  be  applied 
here  by  incorporating  it  in  a simpler  method  as  a requirement  that  “the  full-load  efficiency  of  each  motor  in  the 
sample  must  be  greater  than  the  value  of  efficiency  equal  to  the  nominal  efficiency  NE  reduced  by  an  amount 
equivalent  to  a 15%  increase  in  total  losses  at  full-load,  i.e.  the  value  given  by 

100 

Proposed  Test  for  Enforcement  (Appendix  B to  Subpart  G of  Part  431) 

It  is  proposed  that  the  rules  for  enforcement  testing  be  similar  to  those  for  compliance.  The  primary  difference 
being  that  the  rules  for  enforcement  testing  be  based  on  the  total  permissible  variation  in  measured  efficiency 
permitted  by  the  NEMA  MG  1 Standard.  The  recommended  rules  for  enforcement  testing  would  then  be  that 
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the  “average  full-load  efficiency  of  the  sample  is  not  less  than  the  value  of  efficiency  equal  to  the  nominal  efficiency 
A^E  reduced  by  an  amount  equivalent  to  a 15%  increase  in  losses  at  full-load,  i.e.  the  value  given  by 

iQQ 

The  second  condition  that  must  be  satisfied  by  the  sample  is  the  again  similar  to  that  for  determining  compliance 
that  “the  full-load  efficiency  of  each  motor  in  the  sample  must  be  greater  than  the  value  of  efficiency  equal  to 
the  nominal  efficiency  NE  reduced  by  an  amount  equivalent  to  a 20%  increase  in  total  losses  at  full-load,  i.e. 
the  value  given  by 

IQQ 
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Example  of  Normal  Distribution  of  Total  Population  and 
Distribution  of  Means  of  Samples 
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Figure  Dl: 


Probability  That  Mean  of  Sample  is  Below  Efficiency  Value 
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Example  of  Normal  Distribution  of  Limited  Population  and 
Distribution  of  Means  of  Samples 
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Figure  D3: 


Probability  That  Mean  of  Sample  is  Below  Efficiency  Value 
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Efficiency  Distribution  for  Populations  of  2 Different  Motor 

Designs 


88.5  89.0  89.5  90.0  90.5  91.0  91.5  92.0  92.5 

Efficiency  in  Percent 


Population  1 

“ “ “ Sample  of  2 

“ “ Sample  of  5 

Population  2 

“ Sample  of  2 

^ Sample  of  5 

Figure  D5: 


Probability  That  Mean  of  Sample  is  Below  Efficiency  Value 


88.5  89.0  89.5  90.0  90.5  91.0  91.5  92.0  92.5 

Efficiency  in  Percent 


Samples  of  1 , Pop  1 

“ - “ Samples  of  2,  Pop  1 

— — Samples  of  5,  Pop  1 

Samples  of  1,  Pop  2 

~ Samples  of  2,  Pop  2 

Samples  of  5,  Pop  2 

Figure  D6: 


27 


I 


28 


Appendix  E 


Supplemental  Analysis 


As  noted  on  page  5,  the  operating  characteristics  of  the  NEAIA  compliance  criteria  are  influenced  by  the  value 
of  the  coefficient  used  in  criterion  (A)  (see  page  4).  The  NEAIA  proposal  recommends  that  compliance  testing 
be  based  on  the  use  of  1.05  for  this  coefficient.  The  operating  characteristics  of  the  NEMA  compliance  criteria 
for  this  value  are  shown  on  page  9.  The  analyses  presented  in  this  Appendix  were  performed  at  the  recjuest 
of  the  DOE  in  order  to  evaluate  modification  of  the  value  of  the  (A)  coefficient,  and  to  compare  the  operating 
characteristics  of  the  NOPR  sampling  plan  for  enforcement  testing  with  the  NEMA  criteria  for  compliance 
testing.  These  supplemental  analyses  include:  Model  calculations  of  the  operating  characteristics  of  the  NEMA 
compliance  criteria  with  the  (A)  coefficient  set  to  values  of  1.03  and  1.01.  These  data  are  presented  in  Figs.  El  and 
E2,  respectively.  In  the  remaining  figures,  the  operating  characteristics  of  the  NOPR  protocol  for  enforcement 
testing  and  the  NEMA  compliance  criteria  are  compared.  For  these  comparisons,  the  operating  characteristics  of 
the  NOPR  enforcement  protocol  at  90  percent  and  99  percent  statistical  confidence  are  plotted  together  with  the 
.90  contours  for  the  NEMA  compliance  criteria.  Data  for  the  NEMA  compliance  criteria  with  an  (A)  coefficient 
of  1.05,  1.03,  and  1.01  are  plotted  in  Figs.  E3,  E4,  and  E5,  respectively. 
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Figure  El:  Operating  characteristics  of  a modified  NEMA  compliance  protocol.  Here  the  coefficient  in  criterion  (A)  of 
the  NEMA  protocol  for  compliance  testing  is  1.03.  Model  calculations  for  samples  of  two  and  five  are  shown  in  a)  and 
b),  respectively.  The  contours  indicate  the  probability  of  demonstrating  compliance,  e.g.,  the  .90  contour  corresponds  to 
a 90  percent  likelihood  of  demonstrating  compliance. 
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Figure  E2:  Operating  characteristics  of  a modified  NEMA  compliance  protocol.  Here  the  coefficient  in  criterion  (A)  of 
the  NEMA  protocol  for  compliance  testing  is  been  1.01.  Model  calculations  for  samples  of  two  and  five  are  shown  in  a) 
and  b),  respectively.  The  contours  indicate  the  probability  of  demonstrating  compliance,  e.g.,  the  .90  contour  corresponds 
to  a 90  percent  likelihood  of  demonstrating  compliance. 
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Figure  E3:  A comparison  of  the  operating  characteristics  of  the  NOPR  protocol  for  enforcement  testing  and  the  NEMA 
compliance  protocol.  The  operating  characteristics  of  the  NOPR  protocol  at  90  percent  and  99  percent  statistical 
confidence  are  indicated  respectively  by  the  solid  lines  in  a)  and  b).  The  .90  contours  of  the  NEMA  compliance  protocol 

are  shown  for  samples  of  two  ( ) and  five  (—  — — ).  Here  the  coefficient  in  criterion  (A)  of  the  NEMA  protocol 

for  compliance  testing  is  1.05. 
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Figure  E4:  A comparison  of  the  operating  characteristics  of  the  NOPR  protocol  for  enforcement  testing  and  the  NEMA 
compliance  protocol.  The  operating  characteristics  of  the  NOPR  protocol  at  90  percent  and  99  percent  statistical 
confidence  are  indicated  respectively  by  the  solid  lines  in  a)  and  b).  The  .90  contours  of  the  NEKIA  compliance  protocol 

are  shown  for  samples  of  two  ( ) and  five  (—  — — ).  Here  the  coefficient  in  criterion  (A)  of  the  NEMA  protocol 

for  compliance  testing  is  1.03. 
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Figure  E5;  A comparison  of  the  operating  characteristics  of  the  NOPR  protocol  for  enforcement  testing  and  the  NEMA 
compliance  protocol.  The  operating  characteristics  of  the  NOPR  protocol  at  90  percent  and  99  percent  statistical 
confidence  are  indicated  respectively  by  the  solid  lines  in  a)  and  b).  The  .90  contours  of  the  NEMA  compliance  protocol 

are  shown  for  samples  of  two  ( ) and  five  (—  — — ).  Here  the  coefficient  in  criterion  (A)  of  the  NEMA  protocol 

for  compliance  testing  is  1.01. 
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